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METHOD AND APPARATUS FOR stability, distribution of end-to-end delays and lost packet 

DETERMINING VOIP QOS rates. These proposed methods are primarily concerned with 

CHARACTERISTICS OF A NETWORK measuring QoS characteristics on a single stream of packets 

USING MULTIPLE STREAMS OF PACKETS such as that illustrated in FIG. 1, wherein a sending host 101 

AND SYNCHRONIZING MEASUREMENTS 5 and a pinging host 102 are provided. 

OF THE STREAMS As shown in FIG. 1 the sending host 101 sends a (single) 

stream of packets across the packet switched network 103. 

BACKGROUND OF THE INVENTION J£ * T^Z^Z 
The present invention relates to a method and apparatus 10 sending host 101 is received by the pinging host 102. The 
for determining Voice Over Internet Protocol (VoIP) Quality pinging host 102 adds information to each of the packets and 
of Service (QoS) characteristics of a network using multiple returns the packets to the sending host 101 across the packet 
streams of packets, wherein measurements obtained as a switched network 103. Thus, the system illustrated in FIG. 
result of the multiple streams of packets are synchronized 1 allows for round trip measurements of QoS characteristics 
relative to each other to permit the QoS characteristics of 15 to be performed. The round trip measurements have the 
parts of a network to be reliably determined. advantage of avoiding complications arising from the syn- 
Voice or telephony services can now be provided over a chronization of the of the clocks applied to the sending host 
packet switched network, such as the Internet. These packet 101 and the pinging host 102, and providing an efficient 
switched networks are commonly referred to as Internet emulation of real full-duplex VoIP conversations. 
Protocol (IP) networks. Delivery of telephony in IP-based 20 An example of the format of a packet used in a round trip 
networks is called voice over IP (VoIP), because the Internet measurement of QoS characteristics is illustrated in FIG. 2. 
Protocol according to various IP based standards is the The packet 200 as illustrated in FIG. 2 has various fields for 
primary bearer protocol used. One such IP based standard, storing information added to the packets by each of the 
for example, is the International Telecommunication Union hosts. For example, fields 201 and 202 store time stamp data 
(ITU) H.323 Standard which provides a foundation for 25 r TS 1 and packet sequence number data SEQj respectively, 
audio, video and data communications across IP networks. The TS lf and SEQi data are entered by the sending host 101 
VoIP is a cost effective means of transporting digitized prior to sending the packet 200. Fields 203 and 204 store 
audio signals. However, in order to provide VoIP minimum time stamp dataTS 2 and packet sequence number data SEQ 2 
guarantees must be met where packets containing the audio 3Q respectively. The TS 2 and SEQ 2 data are entered by the 
signals will arrive within a set delivery time and will not be pinging host 102 when returning the packet to the sending 
discarded due to queue overflows. For example, some audio host 101. The pinging host 102 returns the packet 200 to the 
and video "play-back" applications are intolerant of any sending host 101, Field 205 stores time stamp data TS 3 
packets arriving after play-back time. Further, some appli- which is entered by the sending host 101 upon receipt of the 
cations have hard realtime requirements in order to operate packet 200 returned by the pinging host 102 to indicate the 
properly. Thus, the ability to provide at least some kind of 3 time the packet 200 completed its round trip, 
guaranteed services is needed. These guaranteed services are By use of the above described information stored in the 
provided in packet switched networks in the form of Quality fields of the packet 200 having completed the round trip, 
of Service (QoS). QoS characteristics of the portion of the network upon 
The original IP standard provides no QoS support in the ^ which the packet completed the round trip can be deter- 
form of limits in packet delivery delay or lost packets. mined. QoS characteristics of the portion of the packet 
Accordingly, variations in end-to-end packet queuing delays switched network are at acceptable levels when limits such 
and lost or discarded packets can occur due to changing as end-to-end delay and packet loss are not exceeded, 
network conditions. To remedy this, QoS standards have A high end-to-end delay lowers the QoS characteristics of 
been proposed such as Differentiated Services (DiffServ) 45 the stream of packets as experienced by an end user. A "high 
standards disclosed in "Definition of the Differentiated Ser- quality" QoS may set end-to-end delay to be less than 250 
vices Field (DS Field) in the IPv4 and IPv6 Headers" by K. ms, whereas "best" QoS may set end-to-end delay at 150 ms. 
Nichols et al, RFC 2474, Network Working Group, IETF, Delays exceeding a target value might be interpreted as 
December 1998 and "An Architecture for Differentiated losses, resulting in "limited delay". Jitter, or variation of 
Services" by S. Blake et al, RFC 2475, Network Working 50 packet inter-arrival times at-the receiving host is important 
Group, IETF, December 1998. Also QoS standards have for receiver play-back buffer dimensioning. Thus, determin- 
been proposed such as Integrated Services (IntServ) Stan- ing a value of jitter is important. The effects of packet loss 
dards as disclosed in "General Characterization Parameters on QoS is more complexed. A tolerable packet loss rate 
for Integrated Service Network Elements" by S. Shenker et depends on the coder/decoder (CODEC) used since such a 
al, RFC 2215, Network Working Group, IETF, September 5S CODEC may employ QoS counter-measures such as For- 
1997. When the QoS for a data stream is guaranteed, limits ward Error Correction (FEC). An important factor affectin 
can be set on end-to-end delays and packet loss. Further, the Q 0 S of a packet stream is the correlation of losses which are 
over provisioning of network resources in small scale appli- measured as conditional loss probability distribution clp(n.) 
cations can be avoided. (i.e., the set of probabilities P(r\) that n adjacent packets are 
Whatever method of providing guaranteed QoS for VoIP eo l° s 0 scalar conditional lost probability clp (i.e., the 
is used, measurements are an invaluable tool in determining probability that the loss of a packet is followed by another), 
whether the QoS guarantees are being met. This is especially Thus, the measurement of QoS characteristics determined 
true for IP networks in which data and voice streams based on the information stored in the fields of packets that 
co-exist. nave completed the round trip may include average delay- 
Various methods have been proposed for measuring QoS 65 limit Round THp Time (KIT) delay (dr,), delay-limited loss 
characteristics in packet switched networks. Such measure- (1,), jitter (j) and average length of sequences of lost packets 
ments have been performed to address issues like router (pig)* The term "delay-limited" loss 1, refers to packets 
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exceeding a certain limit, for example, 250 ms. Such packets provides streams of time series data useful in determining 

are counted as losses and ignored in computing dr r the QoS characteristics of the network. Synchronization of 

The above described method of calculating QoS charac- the streams of time series data is achieved in the analysis 
teristics using a single stream of packets suffers from various phase by displacing each member of a pair of streams of 
disadvantages. For example, performing measurements on a 5 time series data relative to each other until a common 
single stream of packets in a network is not a reliable phenomenon occurring in each member of each pair of 
measure of the QoS experienced by various users in various streams match in the time direction. The common phenom- 
parts of the network. Since only a single stream of packets en0Q may be any evcnt mat simultaneously effects the 
is used for measuring QoS characteristics, the measurements ^ of ^ streams of kets Qncc thc strcams of ^ 
are only relevant for the portion of the network upon which 10 series data haye bcen synchronizcd to cach othcr> QoS 
toe stream ot packets perform the round trip. Further, the charact cristics of the measured part of the network can be 
QoS characteristics may be affected in different ways m accuratc i y and reliably determined. Determining QoS char- 
other parts ot the network. acteristics based on the synchronized streams of time series 

Further, co-located measurements when the sending hosts data prov ides a reliable measure of the QoS provided to 

are located m one part of the network and pinging hosts are 15 various uscrs locatcd in different parts of mc ae twork. On 

located in another part of the network yield more reliable fat othcr hand, by making multiple measurements from a 

information. In such an arrangement, QoS characteristics of single i ocat ion more accurate information can be obtained, 

different parts of the entire network or in different parts of ^ abQve ^ second and ^ time ^ 

a portion of the network can be performed. Such is not mation ^ rtkularl in determining delays mat may 

possible when a single stream of packets is used. 20 ^ ^ ^ network ; oth er c £^o be added to 

Therefore a reliable method for determining QoS char- me padkel b ^ measuring and rece iving hosts as the 

acteristics of various portions of a network experienced by streams of kets taverse ^ round ^ from me measur . 

many users is desired Further, it is desired to be able to mg host to the host md back Such in f orma tion 

correlate the measured QoS characteristics of various por- for exampl e 7 be packet sequence numbers which 

tions of the network to ^each other to aid in evaluating the 25 sequentially identify the sequential location of each of 

QoS characteristics of the entire network T^e same method packet in the streams of packets Packet Kcpience oumbers 

can be used to obtain more reliable data for a single part of m useful in providing a means t0 measure padket losS- 

a network as well. T . . . . , t . t . f4 . : , 

It should be noted that each of the measuring and receiv- 

SUMMARY OF THE INVENTION ing hosts can, for example, be arranged to be at the network 
The present invention provides a method and apparatus 30 boundaries and can be either a router or a proxy server, 
for determining Voice Over Internet Protocol (VoIP), Qual- Further, each of the measuring hosts rather than sending a 
ity of Service (QoS) characteristics of a network using stream of Packets each having the format described above 
multiple streams of packets, wherein measurements can > for example, send a stream of packets which includes 
obtained using the multiple streams of packets are synchro- real traffic - ^ corresponding receiving host upon receipt of 
nized relative to each other to permit the VoIP, QoS char- me stream of packets including the real traffic forwards the 
acteristics of the network-to be reliably determined. stream of packets toward its final destination and sends back 
Accordingly, the present invention provides a method and < reflect ) a C0 Py of ^ stream of P ackets Eluding the real 
apparatus of determining. QoS characteristics of a network traffic to lhe measu ™g host Each of the packets of the 
using a plurality of streams of packets. In the present m stream of packets mcluding real trafBc can be extended in a 
invention, each of a plurality of measuring hosts sends a mamer to include iiiformation corresponding to the time and 
stream of packets to a corresponding one of a plurality of sequence ™mber information described above for measure- 
receiving hosts. Each packet of the stream of packets being menl P ur P oses - 

sent from the measuring host includes first time information BRIEF DESCRIPTION OF THE DRAWINGS 

added by the measuring host indicating the time the packet AK ~, . . ... , A , . 

was sent from the measuring host. Hie stream of packets . present invention will be more apparent from the 

sent from the measuring host is received by the correspond- description, when taken in conjunction 

ing receiving host and is immediately returned to the mea- Wlth mc accompanying drawings, in which: 

suring host. Each packet of the stream of packets being FIG 1 15 a schematic diagram illustrating a conventional 

returned by the receiving host includes second time infor- 50 method of detecting QoS characteristics using a single 

mation added by the corresponding receiving host indicating stream of packets; 

the time the packet was returned. FIG. 2 is a schematic diagram illustrating the format of 

The stream of packets returned by the corresponding eacn Packet of a stream of packets used in measuring QoS 

receiving host are received by the measuring host. The characteristics of a network; 

measuring host adds to each packet of the stream of packets 55 FIG- 3 is a schematic diagram illustrating the arrangement 

returned by the corresponding receiving host third time use d for applying multiple streams of packets to a network 

information indicating the time the packet completed a t0 determine QoS characteristics; 

round trip from the measuring host to the corresponding FIG. 4 is a schematic diagram illustrating the arrangement 

receiving host and back. for controlling a plurality of measuring hosts for sending the 

Hie plurality of streams of packets received by the eo P luralitv of streams of packets; 

plurality of measuring host provide a plurality of streams of FIG. 5 is a signaling diagram illustrating the signaling 

measurement information, (time series data) related to the between the controlling host and one of the measuring hosts; 

first, second and third time information. The streams of time FIG. 6 is a chart graphically illustrating maximum and 

series data are synchronized to each other during an analysis minimum correlation quantities with respect to displacement 

phase taking place after the measurements. 55 for two streams of time series data; and 

The first, second and third time information included in FIG. 7 provides a table which includes quantitative infor- 

each packet of each of the plurality of streams of packets mation as to the effect of noise on correlation quantities. 
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DETAILED DESCRIPTION OF THE can be added by the measuring and receiving hosts to each 

INVENTION packet of the stream of packets as it travels from the 

Features of the present invention are illustrated and will measuring host 301 to the receiving host 302 and back, 

be described with respect to FIGS. 2-7. Further, the size of each packet of the stream of packets and 

r— 4 . >j j j ^ 5 the transmission frequency of the packets in each of the 

The present invention provides a method and apparatus 4 * t , ■ * • • 

e . . . . ^ c, . „. • t « c . c . i streams or packets can be set in a manner so as to aid in 

for determining QoS characteristics of parts of a network , , • • rt « u c ^ ir 

, v f c . c r determining QoS characteristics of the network for a par- 
using a plurality of streams of packets, wherein streams of ucu i ar CODEC 

measurement information (streams of time series data) 

obtained as a result of the plurality of streams of packets are ^ fitst > second and third time information, the first and 

synchronized relative to each other to permit the QoS 10 second P acket sequence number information and any other 

characteristics of the entire network to be reliably deter- information added to the packets of the streams of packets 

mined, that have completed the round trip provides measurement 

The* present invention provides apparatus such as that ^formation regarding different characteristics of the net- 
illustrated in FIGS. 3 and 4. The apparatus includes a „ work *mente 303 of the packet switched network 103. 
plurality of measuring hosts 301-1 through 301-n and a 15 arrangement of measuring host 301 and receiving 
plurality of receiving hosts 302-1 through 302-m. Each hosl 302 88 Crated * FIG. 3 provides a plurality of 
measuring host 301 sends a stream of packets through streams of measurement information (streams of time series 
network elements 303 of the packet switched network 103 to whlch are used to determme me Q° S characteristics of 
a corresponding receiving host 302. Each packet of the on ^ enUre Detwork - However, m order for these streams of 
stream of packets sent by the measuring host 301 includes at Ume senes dala t0 be effective * determining the QoS 
least first time information TS, and first packet sequence characteristics of the network, the streams of time series data 
number information SEQ, and possibly dummy length must be synchronized relative to the each other. A descrip- 
information such as that illustrated and previously described Uon of me features of the present invention with respect to 
with respect to FIG. 2. The first time information TS, is a oc ^ md synchronization of the streams of time 
time stamp indicating the time the packet was sent from the 25 ^ dat ? obtained * om me streams of P ackets that nave 
measuring host 301. The packet sequence number informa- completed a round trip is provided below, 
tion SEQi indicates the sequential location of the packet in 0ne of the S oals m designing the apparatus of the present 
the stream of packets being sent by the measuring host 301. invention having a plurality of measuring and receiving 

The stream of packets sent from the measuring host 301 ^ hoste is to causc « uU le disturbance to the measurement 

travels through the network elements 303 of the packet process as possible. In other words, the measurements used 

switched network 103 to the receiving host 302. Each of the to determine QoS characteristics of the network should not 

measuring hosts 301 may be positioned at various locations be effec ted-by host synchronization traffic. Another goal in 

in the packet switched network 103 so that the QoS char- designing the apparatus of the present invention is that when 

acteristics determined for the network is representative of 35 performing analysis with respect to the plurality of streams 

QoS characteristics of the entire network, allowing for of time data provided by the streams of packets to 

comparison of QoS characteristics in different parts of the determine QoS characteristics, a high degree of synchroni- 

network. Alternatively, the measuring hosts 301 can be zation between the streams of time series data is desirable, 
co-located in one part of the network and the receiving hosts In order to accomplish the above stated goals, the present 

302 in another part of the network allowing for acquisition ^ invention provides a control structure for the plurality of 

of multiple samples of QoS characteristics in a portion of the measuring hosts 302 in the manner as illustrated in FIG. 4. 
network. Thus, measurement taken in this manner yield As per in FIG. 4, each measuring host 301 is connected to 

measurement results that are more reliable, a controlling host 401 which controls the initiation and types 

Hie stream of packets sent by the measuring host 301 and of measurements to be conducted by the measuring host 201. 

traveling through the network elements 303 in the packet 45 The controlling host 401 also performs processes to deter- 

switched network 103 are received by a corresponding mine whether the connections between the controlling host 

receiving host 302. The corresponding receiving host 302 401 and the measuring hosts 301 are properly configured 

adds second time information TS 2 and second packet and have not failed. The controlling host 401 controls 

sequence number information SEQ 2 to each of the packets operation of each of the measuring hosts 301 by the use of 

of the packet stream and returns the stream of packets to the 50 a Linux Daemon process 402 which is executed in each of 

measuring host 301 via the network elements 303 of the the measuring hosts 301. (Linux is a computer operating 

packet switched network 103. The second time information system). It should be noted that any type of process can be 

TS 2 is a time stamp which indicates the time the packet is used so long as the process provides the desired results, 
being returned to the measuring host301. The second packet i n ea ch measuring host 301, the daemon process 402 

sequence number information SEQ 2 provides an indication 5S ii ste ns to a Transmission Control Protocol (TCP) socket for 

of the sequential location of the packet in the stream of commands from the controlling host 401. As illustrated in 

packets. PIG 5^ measurements in each of the measuring hosts 302 are 

The stream of packets returned by the corresponding initiated in response to the controlling host 401 broadcasting 

receiving host 302 and having traveled through the network or sending individually a "GO" command to the daemon 

elements 303 of the packet switched network 103 is received eo process 402 resident in each of the measuring hosts 301 via 

by the measuring host 301. The measuring host 301 adds to a socket connection. Upon receipt of the GO command, each 

each packet of the stream of packets third time information measuring host 301 begins transmission of a stream of 

TS 3 , a time stamp, indicating the time the packet completed packets to a corresponding receiving host 302 via the 

the round trip from the measuring host 301 to the corre- network elements 303 of the packet-switched network 103. 

sponding receiving host 302 and back. 65 The process of sending the stream of packets from each 

It should be noted that any other type information that measuring host 301 is conducted in the manner described 

would aid in determining QoS characteristics of the network above, wherein first time and packet sequence number 
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information TS 4 and SEQj, respectively, are added by the members of each pair of streams of measurement informa- 

measuring host 301 to each packet prior to transmitting the tion relative to each other until a match occurs in the time 

stream of packets, the receiving host 302 upon receipt of the direction of an event that simultaneously the QoS of all 

stream of packets returns the stream of packets such that streams of packets are matched in the timed direction. Alow 

each packet has added by the receiving host 302 second time 5 correlation information value indicates that the events 

and packet sequence number information TS 2 and SEQ 2 , effecting both members of the pair of streams of measure- 
respectively, and upon receipt of the returned stream of ment information has not been matched in the timed direc- 

packets by the measuring host 301 each packet has added don A fli h correlation inflation value indicates that the 

thereto tod time information TS 3 . In each measuring host cvent which effect ^ Qq$ of eflch of ^ membeR . of ^ 

302 upon compleUon of the test consisting of the stream of w ^ of of mformation havc bccn malchcd in thc 

packets, a Test Ok> signal is sent to the controlling host ^ mcrcby indicating svnchroaization of ^ 

streams of measurement information. 

It should be noted toatwjft respect to the GO command, when cQ ^ streams measllrements 

f «»torfling hojl 401 sends measurements parameters to Momiti ^ (cplJ c]ocks rates of the ^ 

mcmeasunr^hosts^suchas.forexampk.thenumberof 15 differ) and ^ hcemsnt (rneasurem en.s start at different 

packets to ; be transmitted as jpart ofthe stream ,of packets, the ^ ^iween streams of measuremenU information are 

transmission frequency of the packets of ^he streams of ^ H ^ fol , owin requiremenls can be laced 

packets, etc. TTius the controlling host 401 knows how long ^ a melhod for m&asvl mg degree of synchronization of 

a measurement takes in each of the measuring hosts 301. QoS characteristics betwee * di | erent ^ams of measure . 

Once a measurement in a measuring host 301. has been on _ 

i * a 4U «r * at^» • i • * * *l * iv 20 ments information: 
completed, then a Test OK signal is sent to the controlling 

host 401. If the "Test OK" signal has not been received Method to **** ^ h0Q ' 

beyond a certain period of time corresponding to how long Method for synchronizing different delay traces. 

such measurements take, then the controlling host 401 Method must be robust against measurement noise and 

determines that an error or fault has occurred and issues a ^ random delay peaks. 

fault indication. In tests performed using a small selection of Intel i586/ 

One of the important features of the arrangement of the i686 based Linux Hosts > the maximum observed clock skew 

present invention as illustrated in FIGS. 3 and 4 is to provide was of me order of 015 promilles. This translates to roughly 

apparatus which coordinates the simultaneous performance a difference of a single voice frame length per 6000 frames, 

of measurements by a plurality of measuring host each 30 Dilation, or clock skew of the clock of a host relative to 

performing operations with respect to different streams of mat of another host, can be detected by having both the 

data. However, as described above QoS characteristics of a measuring host and receiving host to mark a packet i of a test 

network can be reliably and accurately determined when the strcam of packets with a time stamp denoted by tsj and ts r \ 

plurality of streams of measurement information resulting respectively. As the clocks of the two host need not be 

from the plurality of streams of packets are synchronized 35 synchronized, the quantity At^ts'.-ts^ is not necessarily 

with respect to each other. The synchronization of the meaningful in determining clock skew. However, the change 

plurality of measurement information is a based on a cor- of Ats ' ^ res P ect to sequence number corresponds to 

relation of the plurality of streams of measurement infor- clock skcw ( c )> as dcfincd b y the differential equation below: 
mation so that a common phenomenon effecting the QoS 

characteristics of each of the streams of packet are matched 40 c _ th. ^ 

to each other. dl 

When estimating QoS characteristics of a network, it is 

important to be able to differentiate between events effecting Analyzing each stream of measurement information using 

only a single stream of packets and events which simulta- the first and second time information provided by first and 

neously effect the QoS characteristics of all of the streams of 45 second time stamps which corresponds to \sj and ts/ 

packets. Events which affect only a single stream of packets respectively allows for a determination of clock skew which 

may, for example be errors in the operation of Network can be used to aid in synchronizing respective streams of 

Interface Cards (NIC) in a Local Area Network (LAN). measurement information. 

Events which may simultaneously effect the QoS character- According to the above, in order to calculate correlation 

istics of all streams may, for example, be when the queue of 50 information displacement of two streams of measurement 

a router in the packet switched network becomes full thereby information must be conducted. Finding the displacement of 

discarding any subsequent packets which may have been two streams of measurement information involve comparing 

routed to the router. time information of the two streams of measurement infor- 

By detecting when events occur that simultaneously effect mation relative to each other. It should be noted that no 

the QoS characteristics of all of the streams of data, it 55 assumption about spectral structure of the streams of mea- 

becomes possible to synchronize the streams of measure- surement information is made. This is due to the random 

ments information relative to each other so that the streams nature of QoS characteristics in networks when the capacity 

of measurement information can be properly analyzed to of the transfer channels are efficiently used. Thus, methods 

determine QoS characteristics of the entire network. Events related to spectral decomposition may be deemed inappro- 

which simultaneously effect QoS characteristics in all of the 60 priate with respect to the calculation necessary for the 

streams of data can be highlighted by calculating correlation present invention. 

information indicating the degree of correlation between The comparison of the two streams of measurement 

members of a pair of streams of measurement information. information can be approached from at least two different 

The higher the correlation information value the higher the directions. From one direction, the properties of the differ- 

degree of information between the members of the pair of 65 ences between the two streams of measurement information 

streams of measurement information. Calculating the cor- s 2 -s a can be studied. In the other direction, variations in the 

relation information essentially involves displacing the mean values in the two streams of measurement information 
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and ^ can be interrelated. Both approaches will be 
discussed below. 

The first correlation quantity is a normalized (LI) corre- 
lation of differences between the two streams of measure- 
ment information (time series data) Sj and or the average 
absolute value of differences between the two streams of 
time series data as a function of displacement d as defined 
below. Use of LI instead of a more general Ln is due to the 
goal of providing robustness toward random differences 
between the two streams of time series data. 



10 



u L1 and <n L1 >, respectively, and_the average value and stand 
deviation of r\ PC is denoted as n^ and <n PC > respectively. 
Further, the correlation values related to "optimal" displace- 
ment 



and 



10 



'a('+<0|| 



(2) 



15 



In the above equation, l^max (0,d) l^omin Cn/n+d) and 
m^-l-i+l where tj is the smaller of die lengths of the two 
streams of time series data. Sj and are used to denote 
average values of the streams of time series data. 

The second correlation quantity is an average pair corre- 
lation (PL) of the two streams of time series data as defined 
below: 



(3) 



If the streams of time series data are correlated, the 
optimal displacement shows up as a global minimum in r\ L1 
and as a maximum in r\ PC . For a case of a pure signal having 
no noise in the measurement, there-is a discontinuity in the 
derivative dn^/dd. An actual example of two correlation 
quantities in a real network is illustrated in FIG. 6. 

The correlation quantities often display minima and 
maxima even when calculated for a non-optimal value of 
displacement d. The use of multiple synchronization mea- 
sures provides a check against random phenomena. Firstly, 
the numerical values of y\ L1 and r\p C indicate the degree of 
correlation. Secondly, the proximity of displacements cor- 
responding to the maximal correlations for the two quanti- 
ties provides another indication of the degree of correlation. 

The robustness property of the synchronization methods 
described above was tested using two discrete streams of 



25 



(as determined by the minimum of n L1 and the maximum of 
Dpc by 



and 



20 



Then, the following robust quantities may be defined as: 



Ru + <rt£j) 



APT 



<6) 



(7) 



30 



35 



and 



40 



are measures of the signal-to-noise ratio of depth of the 
smallest minimum (resp. height of the largest maximum) of 
n L1 (resp. n PC ). 
Another part of multi-stream QoS measurements is to 

^ series ^ 

peaks, with the latter signal deliberately displaced with found to be good measures for QoS f airness between the 
respect to the former streams: 

1. Fairness with respect to loss rate. Here the delay- 
(4) limited loss rate 1, is calculated for each stream i 

50 individually. Fairness index is calculated for the col- 
lection of the individual loss rates. The fairness index 
is defined as 



*i(0 = a[i+*pwc(«-^]] 



(5) 



According to the above, p(t) is controlled by a random 55 
variable where p(t)=l if random variable x>0.99. Both % and 
r\ are white noise random variables picked from the range 
[0,1]. 

In the test cited below, values A=2, B=10 and d=50 were 
used with varying C (noise-to-signal ratio). The results set 60 
forth in Table 1 of FIG. 7 show that the correct displacement 
value can be found even with high noise levels. On the other 
hand, the value and n FC varies depending on noise, 
which is why it was found useful to compare the values of 
the two quantities corresponding to the "optimal" displace- 
ment to a range of variation of the quantity in. question. 
Average value and Standard deviation of u L1 is denoted as 



(8) 



65 



Values of fairness index close to zero indicate a large 
variation between magnitudes of individual l'/s, whereas 
values close to unity indicate that the compared quantities 
are very close to each other. 

2. Standard deviation of the loss rate over all the streams, 

<i>. 

Similar techniques can be applied also to other QoS 
characteristics, (e.g., to average delays). 
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It should be noted that each of the measuring and receiv- 
ing hosts can, for example, be arranged to be at the network 
boundaries and can be either a router or a proxy server. 
Further, each of the measuring hosts rather than sending a 
stream of packets each having the format described above 5 
can, for example, send a stream of packets which includes 
real traffic. The corresponding receiving host upon receipt of 
the stream of packets including the real traffic forwards the 
stream of packets toward its final destination and sends back 
(reflect) a copy of the stream of packets including the real 10 
traffic to the measuring host. Each of the packets of the 
stream of packets including real traffic can be extended in a 
manner to include information corresponding to the time and 
sequence number information described above for measure- 
ment purposes. 15 

Therefore, based on the above, the present invention 
provides a method and apparatus for determining VoIP QoS 
characteristics of a network using multiple streams of pack- 
ets. Particularly, the present invention provides a method 
and apparatus that synchronizes the initiation of measure- 20 
ments performed by a plurality of measuring hosts using 
multiple streams of packets and synchronizes multiple 
streams of measurement information obtained by the mea- 
suring hosts based on the multiple streams of packets. In the 
present invention, by use of the synchronized streams of 25 
measurement information VoIP QoS characteristics of the 
entire of network or portions thereof can be determined. 

While the present invention has been described in detail 
and pictorially in the accompanying drawings it is not 
limited to such details since many changes and modifica- 30 
tions recognizable to those of ordinary skill in the art may be 
made to the invention without departing from the spirit and 
the scope thereof. 

We claim: 

1. A method of determining Quality of Service (QoS) 35 
characteristics of a network using a plurality of streams of 
packets, comprising the steps of: 



sending from each of a plurality of measuring hosts to a 
corresponding receiving host a stream of packets, each 
packet including first time information added by said 
measuring host indicating the time the packet was sent 
from said measuring host; 

receiving in each of a plurality of receiving hosts from a 
corresponding measuring host the stream of packets 
sent by the corresponding measuring host; 

returning from each of said receiving hosts the received 
stream of packets, each packet being returned including 
second time information added by said receiving host 
indicating the time the packet was returned; 

receiving in each of said measuring hosts the stream of 
packets returned by said receiving host and adding third 
time information to each packet of the stream of 
packets returned by said receiving host indicating the 
time the packet completed a round trip from said 
measuring host to said receiving host and back; 

generating measurement information based on the 
returned plural streams of packets received in the 
measuring hosts, said measurement information includ- 
ing a plurality of streams of time series data each 
related to one of the returned plural streams of packets; 

synchronizing said streams of time series data relative to 
each other based on an occurrence of an event effecting 
each of the streams of packets, said synchronizing 
including displacing said streams of time series data 
relative to each other; and 

determining QoS characteristics of the network based on 
the synchronized streams of time series data. 

2. A method according to claim 1, wherein the operation 
of the plurality of measuring hosts is synchronized in a 
manner so as not to effect measurements being conducted to 
determine QoS characteristics of the network. 
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